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A Study of the FIT 1984 Fundauentals of VM Uurse 
in Relation to Use of Training on the Job 


Executive Sunmary 

Staff Benbers in OTE/ISTD conducted a study in the winter, 
1984-85. of the Agency's Fundanentals of VM CFVM) Course in 
order to address two broad questions: 1) to what extent have 
eBployees.used their FVM training?; and; 2) how .ight the FVM 
course be improved to better .eet the Agency's training goals. 

These particular evaluation questions were formed in 
response to direction from the OTE Curriculum Committee. These 
questions also represent a consensus of interests among ISTD 
staff and the Hadron contract instructors about the kinds of 
information necessary to improve the match between FVM training 
material and the Agency's job-based VM requirements. 

This study is based on the group of employees who took FVM 
training in FY 1984. For the study, questionnaires were sent 
to all 758 FY84 FVM trainees in order to maximize the prob- 
ability of obtaining representative information about the use 
of FVM training from employees in each of the Directorates as 
well as from employees at various grade levels. One hundre - 
sixteen questionnaires were returned to ISTD unopened because 
the trainee had been transferred; 445 were completed and 
returned before the January deadline, constituting a response 

rate of 691. 


In general, the results of the study indicated that 

. approximately 3/4 of the respondents 
have convenient access to a VM terminal; 


iii 
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• about 70t of the survey respondents 
reported using a VM terainal at least 
several tiaes a aontb; 

, a majority of the respondents use VM 
to create* edit* and manipulate files 
and/or to communicate electronically 
with other users; 

• the Logon sequence was considered to be 
the most useful course objective; using 
FVM to prepare for another ADP course was 
thought to be the least useful objective; 

• approximately 50t of the respondents 
rated each of the content elements as 
’’useful” and ’’very useful”; 

• the most frequently cited reason for 
taking the FVM course was to fulfill 
a job requirement; 

. the single most widely mentioned concern 
was the class composition in terms of 
some students having previous experience 
with VM terminals and others having none; 

In sum* the evaluation findings suggest that* for some 
20-501 of the respondents* the FVM course was not particularly 
useful in the performance of assigned tasks. This percentage 
is too large. As a consequence* ISTD is working to revise both 
the course administration and content to be congruent with the 
Agency's philosophy of skills training and the employees’ job 

responsibilities. 


iv 
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A Study of the Y 1984 Fundanentals of VM )urse 
in Relation to Use of Training on the Job 


Introduction 

During the winter of 1984-85, staff Bembers in the 
Infornation Systems Training Division (TSTD) conducted a study 
of the Agency's Fundamentals of VM course in order to address 
two broad questions: 

• To what extent have employees used their 
Fundamentals of VM (FVM) training? 

• How might the FVM course be improved to 
better meet the Agency's training goals? 

These particular evaluation questions were formed in 
response to direction from the OTE Curriculum Committee. These 
questions also represent a consensus of interests among ISTD 
staff and the Hadron contract instructors about the kinds of 
information necessary to improve the match between FVM training 
material and the Agency's job-based VM requirements. 

This study is the first in a series of program assessments 
within ISTD. The decision to systematically incorporate 
evaluation findings into the planning activities of the FVM 
course was based on several factors: 

a. The skills taught in the FVM course represent 
prerequisite proficiencies for other ISTD-sponsored 
courses. 

b. FVM is the single most frequently offered course. 

c. The demand for FVM is likely to increase over the 
next several years as the Agency continues to its 
transition from paper to electronic communication. 

d. ISTD has taught FVM for approximately two and 
one-half years, and feedback from employees about the 
ways in which they use VM on the job is considered 
critical to improving future FVM course offerings. 
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This report is divi-ed into two parts. The fi. t presents 
the results of our analyses of the survey data that was 
gathered to assess the use of FVM training in job-based 
activities, and is entitled "Uses of FVM Training.” The second 
part of this report Bakes observations and recoBBendations 
regarding the place of the FVM course in aeeting the Agency's 
need for basic coBputer skills training, and is labeled "FVM 
Course in Relation to Agency Conputer Skills Training." 


Uses of FVM Training 


One purpose of this study was to exaaine the extent to 
which the skills taught in the FVM course are used on the job. 
As a consequence, critical FVM skills were delineated by ISTD 
staff and the contract instructors. Forner FVM students were 
then asked to identify the kind of work they did which required 
using VM and to estiaate how frequently they used the terainal. 


SaBple, Method, and Procedures 


Sample 


This study is based on the group of employees who took FVM 
training in FY 1984. For the study, questionnaires were sent 
to all of the FY84 FVM trainees in order to maximize the 
probability of obtaining representative information about the 
use of FVM training from employees in each of the Directorates 
as well as from employees at various grade levels. 
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According to the i -ords both in OTE/Ccntr®l . jistration 
and in ISTD, a total of 758 students completed FVM in FY 84. 

The demographic characteristics of the FY84 FVM students are 
presented on the next page in Table 1. The data in Table 1 
indicate that the largest percentage (45. It) of these students 
were from the DDI. 


As indicated by the data in Table 1, the majority of 
employees who took FVM in FY 84 were female, from the DDI, and 
employed below GS-10 level. 


Then, categories of employees' Agency experience are 
presented by GS grade level in Table 2. 
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The data in Table - indicate that while appro, .nately 50t 
of the FY 84 FVM students are 6S 03-09 and have less than 5 
years of Agency experience, 40» of the entire sanple have three 
or fewer years of Agency experience. 

In sum, the demographic data show that employees receiving 
FVM training tend to be the **new blood*’ of the Agency. 


Method 


The paper-and-pencil survey questionnaire method was used 
to obtain information from the FY84 FVM course participants. A 
single set of questions was designed initially by staff members 
in ISTD. Senior Training Officers and the contract instructors 
critically reviewed the questionnaire and provided suggestions 
which were incorporated into the instrument used in this study. 


Procedures 


On December 3, 1984, 758 FVM survey packets were sent out 
through the Agency mail. The survey packets contained the 
questionnaire, a memo from the Chief, ISTD, describing the 
purpose of the evaluation and a self-addressed return 
envelope. Then, two weeks later, a ’’nudge note” was sent to 
each of the 758 course participants, as a reminder to complete 
and return the questionnaire before the January 7, 1985 
deadline. A copy of the survey questionnaire, cover memo, and 
nudge note may be found in Appendix I. 
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Results 


Response Rate 

Of the 758 survey questionnaires nailed out, 116 were 
returned unopened to ISTD beceuse the forner FVM students hed 
either been tren'sferred or hed left the Agency. Four-hundred 
forty-three questionnaires uere returned to ISTD on or before 
the January deadline. Hence, of the 642 potential survey 
respondents, 443 coupleted and returned a questionnaire, 
constituting a response rate of .691. For the purposes of this 
study, a rate of response In excess of 50t is quite adequate 
and suggests a rather high degree of willingness on the part of 
Agency employees to participate In a follow-up assessment of 
training (particularly if the questionnaire Is received during 
the Holiday season). 

It should also be noted that staff in the Office of Data 
Processing lODP) contacted ISTD in mid-December 19S4 to make 
errang.ments for being Included in the FVM evaluation since ODP 
had also taught several courses in FY t4. As a consequence, 
the same questionnaire and cover memo were mailed to 60 former 
ODP FVM students. Eleven questionnaire packets were returne 
to ISTD because the employees had transferred to other offices 
or were no longer with the Agency. Of the 49 potential ODP 
respondents. 22 completed and returned a questionnaire, 
yielding a response rate of nearly 45». A separate report 
describing the findings of the FVM survey for former ODP 
trainees has been submitted to the Chief of ODP training. It 
may be noted here that, although the ODP survey sample was 
small, the findings were quite similar to those for the larger 

ISTD sample. 
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Access to VM Terminal 

In order to identify the extent to which FVM training is used 
on the job, the availability of a VM terninal at the work site 
was first identified. Items #6 and #7 in the questionnaire 
addressed this basic resource issue and the data are presented in 
Table 3 below. 


Table 3 

Frequency Distribution of Responses 
to Questions about Terminal Access (n»443) 


Question 

6. Terminal in immediate office? yes 

no 


7. 


A) Terminal in office work area 


? 

yes 

no 


B) Is terminal convenient? yes 

no 


n 

% 

345 

77.9 

98 

22.1 

384 

86.7 

59 

13.3 

335 

75.6 

108 

24.4 


The frequency distribution of yes/no responses to questions 
#6 and #7 in Table 3 indicates that approximately 3/4 of the 
survey respondents have convenient access to a VM terminal. In 
addition, 13\ do not have a terminal in either their immediate 
office or in their office work area. As a consequence, the FVM 
training for some 50 students was poorly timed. That is, since 
basic skills training has a short shelf life, the training should 
dovetail immediately with a work assignment designed to utilize 
the training. The shelf life for basic computer training, for 
example, has been reported as being as short as 8 days, after 
which little transfers from the classroom to the job (Goldstein, 
1980). Therefore, with no such immediate assignment, the 
training was of little or no use. 
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Frequency of VM Teriinf ’ Use 

Sinple access and/or availability to a VM terainal* 
however, does not guarantee that the tcrainal will be used. In 
Table 4, the number and percent of responses are presented to 
Question 8, involving the frequency with which a terminal is 

used. 

Table 4 

Frequency Distribution of VM Use (n»443) 


8. How often do you use a VM terminal? 


Response Category 

Nearly every day 
At least several times a week 
Usually several times a month 
Once a month 
Hardly ever/never 


n 

1 



163 

36.8 

95 

21.5 

59 

13.3 

47 

10.6 

79 

17.8 


Perhaps the single most useful data in Table 4 is not that 
approximately 371 report using a VM terminal every day, but 
rather that about 181 "hardly ever or never" use one. An 
additional 111 of the former FVM students report using the 
terminal only about 12 times a year. So, for the purposes of 
this study, it is estimated that roughly 251 of the employees 
who received FVM training in FY84 have found little or no use 

for it. 


Nature of VM Terminal Use 

For those who do use VM, there are essentially four kinds 
of work for which it is typically used; files, data, 
documents, and mail. The number and percent of respondents 
reporting to use the VM terminal for one or more of these kinds 
of work are presented in Table 5, on the next page. 

-9- 


Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00030007-8 



Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00030007-8 

Table 5 

Frequency Distribution of Kinds of Work 
Using VM Terninal (all categories, n»445) 


9. For what kinds of work do you usually use the terminal? 
(check all that apply) 


Response category : 

Create, edit, manipulate files 
Analyze Data (e.g. SAS) 

Write memos, reports 
Use Electronic Mail 


n 

\ 

236 

52. 3t 

75 

16.91 

145 

32. 7t 

201 

45. 4t 


The data in Table 5 indicates that the majority of VM 
users create, edit, and manipulate files} another large user 
gfQup ftre those who Logon to VM and access the electronic 
mail/information system. It should be noted that the figures 
for each category listed in Table 5 represent the total number 
of times the survey respondents checked a particular kind of 
work. That is, some respondents may have checked all the work 
categories, while others may have checked only one. 

In Table 6, the number and percent of respondents who 
checked only one work category are presented. 

Table 6 

Frequency Distribution of Kinds of Work 
Using VM Terminal (only one category, n»445) 


Response Category 

Create, edit, and manipulate 
files (only) 

Analyze Data (only) 

Write memos, reports (only) 
Use Electronic mail (only) 


n 

% 

129 

29.lt 

32 

07. 2t 

42 

09. 5t 

112 

25. 3t 
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The data in Table 6 show that 71.71 of the VM users use the 
terninal for only one type of work. 

In sum, the data in Tables 4, 5, and 6. on both the frequency 
and kinds of VM use noted by the survey respondents, indicate three 

points: 

1) Nearly lOX of the respondents do not regularly use a 
VM terminal. 

2) Roughly lOX of the respondents use one VM terminal 

for more than one kind of work. 

3) A majority of the respondents use the VM terminal 
either for file activity or for accessing AIM. 

Thus, as we examine the respondents ratings of usefulness of both 
the course objectives and content elements, we would expect that 
approximately 30i would find them not useful. A frequency 
distribution of responses to the usefulness of the course objectives 

is presented in Table 7. 


Table 7 

Frequency Distribution of Survey 
Responses on Usefulness of Course Objectives 



Course 

Objectives 

Logon sequence 
Creating files 
Changin g files 


Preparation for 
Other ADP Course 


Not Useful 


Rating of Usefulness 

Very Useful 


Undecided 

“S T" 
TT ITTTX 
"15.TT 
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The data in Table 7 indicate that the respondents found the 
Logon sequence to be the nost useful course objective. When the 
responses in the *’not useful” category are coubined with those in 
the "undecided,” category, preparation for another Autouated Data 
Processing (ADP) course was found to be the least useful course 
objective. Of the 443 FY84 FVM students, 206 reported taking no 
additional computer skills training. Overall, and with the 
exception of the Logon sequence, approximately 50-60» of the 
respondents rated the course objectives as ”useful” to "very 
useful.” The numbers of responses in the "not useful” category 
increased somewhat for the more course-specific content ratings. 

A frequency distribution of the course content ratings is 
presented in Table 8. 


Table 8 

Frequency Distribution of Responses 
on Specific FVM Course Content 


FVH 

Content 

XEDIT Commands 
Input 
Find 
Locate 
X Change 

Retype ~ 

Putd 8 Get 
CMS ; List 

t:opy _ 
Help 
Send files 
Full Screen 
Message 
Course Book 


Not Useful 

uj r~ 

T23 27.81 

TZS 28. 2t 
167 57. JV 

143 

T40 31.6V 

Tii 42.41 
TTA 39.3V 
123 27. W 

TH — 5T75T 
1T2 34.3 V 

158 55. TV 

137 30.9V 

145 32:"7V 

TO — TTTSX 


Rating of Usefulness 
Useful Very 

(nT— t Tnr 

ll6 26 m TIT 

TTT 26711 IT9“ 

114 25.71 sr 

108 24.11 Tor 

"TOT — 217T1 ToF" 

"T03 — 21771 TT 

101 22. '81 rr 

no 24.8^ 12T' 

"T^I 24. 4^ TT 

"m — roi 72" 

— 82 18.51 ST 

— 81 — roToi nF 

124 28.1)1 TF 

■"TT3 — 32. 3i nr 


Useful 

27nT 

26. 81 

13. ST 

22.81 
23.9 V 
lO.ST 
13. li 
29. It 
16.31 
16.31 

i8':tt 

30. 7t 
17.4V 
26.9V 


Undecided 
Cn) \ 

84 18. 9T 

82 18. 4t 

T03 23.21 

91 20. 5i 

90 20. 2T 
102 22.91 

110 24.81 

“8l 18.2V 

111 24.8V 

101 22.81 
To 20.31 
T6 19. 3l 
T7 21. 8t 
“69 15.4V 


The data in Table 8 show that while the "XEDIT” and "Input” 
commands were found to be the most useful on the job, one-third 
or more of the respondents found "Find,” "Retype,” "Putd 8 Get,” 
"Copy,” "Help,” and "Send files” to be not useful. That 
approximately 50t of the respondents rated each of the content 
elements as "useful” to "very useful” is a finding consistent 
with data from other parts of the survey questionnaire. 
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To identify if differences in content ratings were related 
to the different work categories, chi-square tests (X^) of 
independence were performed . As one night expect, the course 
content ratings from those who used VM primarily for electronic 
nail and/or data analysis tended to be in the *'not useful” and 
••undecided” category, and have chi-square values which were not 
significant. On the other hand, ratings from those who use VM 
primarily for filing and writing documents departed significantly 
from independence for all the FVM course content elements. 

Because the cell frequencies in the chi-square analyses were from 
51-201 empty, the Statistical Analysis System (SAS) warned that 
the chi-square results may not be entirely valid. Hence, the 
data from these chi-square tests can be used only to suggest that 
the course content is probably more useful for those who create, 
edit, and manipulate files, and/or write documents than it is for 
those who use a VM terminal primarily for nail and data analysis. 


Course Assessment Comments 

In order to better understand the context of the course 
objectives and content data, comments from the course assessment 
section of the questionnaire are listed below. In general, 
approximately of the respondents offered one or more comments 

for questions Ifl and #3, and about 30t for questions 
Only those pefeepUonT', however, which were mentioned nine or 
more times (representing at least 2t of the survey respondents) 
are listed in this report. It should be noted that there is 
considerable consistency among the type of comments made on all 

the questions. 
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question #1; Why did take FVM? 

OPINION: I took VM because 

• It was a requireaent of ay office work 

Cor to do a better job) 

• I wanted to gain working knowledge of VM/Delta 

Data equipaent to use other systeas 

• It was required/recoamended by aanageaent 

. I am interested in learning about the computer 

• I need to develop/use an electronic filing system 

• VM is necessary for AIM 

• It is a prerequisite to other courses 

. I wanted to reinforce on-the-job training I had 
already gotten 

. I need a broad overview for my management 
responsibilities 

The most frequently cited reason for taking the FVM course 
was a job requirement. Other job related reasons were ”... to 
use other systems”, ”.. .develop/use an electronic filing system”, 
and "...for management responsibilities.” Taken together, the 
sum of the work-based reasons for taking FVM is 284, or about 64% 
of the respondents. ^ 

The few comnents offered for Question #2: In what ways did 
the FVM course iieet your objective?, either repeated what the 
respondent had said in question II, or as in the case of eleven 
individuals, the answer "nothing" or "none" was given. JUnsly — 
percent of the survey respondents left this question blank: 
hence, we can conclude that this question was a very poor one, 
adding nothing useful to the survey. 

Fortunately, for the remainder of the course assessment 
items, the majority of respondents offered their views. For 
question #3, the following comments were offered: 


(n) 

(164) 

(84) 

(78) 

(72) 

(26) 

(24) 

(14) 

( 10 ) 

( 10 ) 
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Quest ion #3; In what wa ,5 were 
course iother than not having a 


you disappointed by ne 
1-1 student to terminal 


OPINION: I was disappointed in that.... 


FVM 

ratio)? 

(n) 


There was 
students 


such a wide diversity among 
knowledge of computers and terminals 


(137) 


Too much time was slotted; 
covered too little material 

There was a lack of practical application 
examples and workshops 

I do not use VM in my present job 

The course material did not include the information 
systems I use in my work 

Not enough time was .lotted; tried to cover too much 
material 

Course was too basic; should have learned more 
commands 

Not enough explanation 

Instructors/teaching assistant were not good 


( 90) 

( 74) 

( 71) 
( 63) 

( 52) 

( 49) 

C 30) 
( 9) 


The single most frequently mentioned disappointment of the 
FVM course involved the class composition. In addition, the 
difficulties associated with being in a class in which the 
students do not enter with relatively the same subject 
ignorance was noted 109 times on another item. (V.. page 3. What 
would you include in the design of an FVM course). In general, 
then, it seems that the students would much prefer to be in a 
homogeneous class - those with no terminal computer experience m 
one group, and those with some experience in another. 


With respect to Questions 14 and #5. only about 1/3 of the 
respondents commented. (There were 130 and 141 responses, 
respectively.) Of each, approximately one-half of the common 

stated **no problem" or none. 


-15- 
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Question #4: What kino_ of problems/challenges ha^ you 
encountered when you use VM that you consider to be related to VM 

literacy? 

OPINION: I have encountered... 

• No problems 

•The need to have a full understanding of VM is 
required before I can use other systems 

«Word processing capabilities which are not as 
user friendly as those in the Nang 

•Difficulties with the exec profile because it 
was not explained in course 

•Documentation for other commands 

Question fS: Were there any elements that, in hindsight, 
have found to be especially worthwhile? 

OPINION: I found especially worthwhile... 

• Nothing 

• Full-screen 
•Editing 
•QQuit 

•Safety/security presentation 
•Explanation of different environments 

Although the comments to Questions #4 and #5 are sparse, 
they can serve as one source of information when considering 
possible FVM course changes. Another potentially useful piece of 
information to future FVM courses is the data on course 
composition. Responses to Questions #6 and #7 underscore the 
diversity of experience with which students enter the FVM course. 

Question #6 : Did you use VM before you took the course? 

YES: 187 (42. 2t) NO: 221 (49. 9t) Blank: 35 (7.9%) 


(n) 

(63) 

( 21 ) 

(17) 

( 11 ) 

( 11 ) 

you 

(n) 

(65) 

(31) 

(26) 

(13) 

(13) 

(9) 
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Question #7: Did you usc another system (e.g. Wang before 
learning VM? 

YES: X»5 (44. OX) *0: 211 (47. 6») El*"!: 5’ 

The responses to Questions #6 end #7 show thet the survey 
respondents were roujhly divided on whether or not they entered 
the FVM course with previous conputer end/or ternintl 
experience.* Since these deta corroborate coaaents offered in 
Question .5, the question for future of FVM courses is the extent 
to which the nu.bers of trainees with prior experience is apt to 
increase over the next several years, especially considering that 
the Agency is continuing to acquire new systens of office 

automation. 


Summary 

Analyses of the survey data gathered to assess the extent to 
which eaployees tend to use their FVM training on the Job suggest 
that approxinately 70t of the FY84 FVM students have work that 
requires use of a VM terninal at least several tl.es a aonth. 

The greatest percentage of these eaployees use VM to either 
create, edit, and aanlpulate files or to coaaunicate 
electronically with other users. 

In addition, the majority use a VM terminal for a single 
work activity. The FVM course content was considered to be .ore 
useful aaong survey respondents who use the VM terminal for wor 
activities which involve files or writing documents. Those 
respondents who use 


•The ratings of course objectives and course content 
were analyted according to whether or not the student had used VM 
or another system prior to taking the FVM course. There were no 
statistically significant differences between the ratings of 
employees which could be attributed to previous terminal 

experience. 
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VM pri«arily for data ai ysis or electronic nail t ied to rate 
the course content as less useful. A.ong all categories of VM 
users, however, the Logon sequence was noted as being the aost 
useful; preparation for another ADP course was thought to be the 
least useful of the course objectives. 

Approximately one-half of the respondents (237) took 
additional ISTD computer skills training, and most of then took 
more than one course. (The most frequently taken courses were 
AIM, SAFE, GIMS, and IVM). 

Overall, opinions expressed in the course assessment section 
of the questionnaire were notably consistent. The most widely 
expressed concern dealt with the composition of the classes. 

That is, the diversity of students previous experience with VM 
terminals and/or other computer-based systems was considered to 
be detrimental to the functioning of the class. Those with 
previous terminal experience tended to find the class painfully 
elementary, redundant, and slow; those, on the other hand, who 
had no prior experience, tended to find the class pace entirely 
too fast and the explanations too shallow. As a consequence, 
while many of the students wanted to cover more commands and 
practical applications during the slotted course time, others 
felt that another day or two could easily be added to the FVM 

course. 

In sum, the evaluation findings suggest that, for the most 
part, the FVM course has been useful to employees in the 
performance of their assigned tasks. For some 20-30% of the 
respondents, however, the FVM course was not particularly 
useful. While it is virtually inevitable that some students will 
not use their training on the job, the percentage of such 
students in the FVM group is too large. For job-based skills 
training courses, there should probably be less than 5% in this 
category. The course administration and course content should be 
designed to be congruent with both the Agency's philosophy of 
skills training and the employees’ job responsibilities. 
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FVM jurse 

Apency Computer Skills Training 


In general, there are two kinds of computer skills training 
courses. One is essential for job perfornance; the other is 
desirable for career advancenent. Requirements for course 
administration and the design of the course content vary 
according to whether the course is categorised as offering 
essential or desirable training. Assuming that the FVM course 
represents training that is essential for the performance of 
assigned tasks and responsibilities, some considerations are 
discussed. It goes without saying that it is pointless to offer 
computer skills training to persons who do not have access to a 

terminal. 


Course Administration 

In terms of delivering the FVM course there is a broad 
concern: How to get the ••right" people in the ••righf course at 
the ••right" time? The findings of the FY84 FVM assessment 
suggest that for approximately 701 of the people, a majority of 
the FVM content was about "right", particularly if the trainee 
intended to use FVM for creating, editing, and manipulating files 
and/or writing documents. The issue, here, is assuring that the 
"right" people are those who have an immediate job related need 
for the course; offering a course that is "right" in terms of 
students^ previous terminal experience; and, placing students in 
the course at the ••right" time - a time that coincides with their 

need to use the training on the job. 
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Assuming the availability of the ”righf course for a moment, 
let us focus on delivering the course in a timely fashion to 
those who really need it. Historically, the FVM course has been 
a prerequisite for other computer skills training courses offered 
by the Agency. Although FVM training has been conducted as 
frequently as resources have permitted, there has usually been a 
waiting-list in excess of 100 applicants.* 

Given that approximately 201 of the survey respondents do not 
use their FVM training on the job, it is likely that some 
employees on the FVM waiting list also have no immediate, 
job-based need for the training. As a consequence, ISTD should 
consider ways to collaborate with OTE Central Registration to 
assure that each of the trainees has a current requirement for 
the FVM course in order to fulfill a particular job 
responsibility. It may be that before course registation is 
conducted on-line, an ISTD/FVM Training Assistant could telephone 
each of the students assigned to a course offering to identify 
whether or not the applicant intends to use FVM knowledge and 
skills on the job. For those who want to take FVM to learn how 
to Logon or to access AIM or to apply for SAFE training, 
alternatives to the entire FVM course should be made available. 
Instructional methods should be designed for those who take FVM 
for non-specific job-based purposes. 


•As of January, 1985, there were 127 employees on the FVM waitine 
list. In addition, 51 employees were already assigned to classes 
scheduled in March and April. As with the sample used in this 
study, a majority of the employees seeking to take FVM were from 

the DDA and DDI. 
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Course Content 

After deter.lniBg through the fVM regl.tr.tlon process th.t 
.oollcent has both a job need and access to a VM temlnal. the 
tndlvLual Should receire. as part of the course 
schedule of the FVM content dllineating the day, . 

*0 h. presented. This schedule of discrete 

could also include a list of nodules reco.nended for partic 
Ims of users. For exa.ple, if the Indl.idual is a no.ice VM 
user, with no previous terninal erperlence, he or she cou 
a teid the Introduction to VM. Keyboard, and logon nodu 
the sane individual were to he using VM to create and 
then the .odules on Xedit commands and Full-Screen wo 
appropriate and recommended. 

in sun. because the present FVM course is an essential, basic 
conpiter sUlls course, it would see. inadvisable « “ 

tailor several FVM courses to c 

within the Agency's user community. Ins „Uted, 

single VM course composed of a series o separa , 

“dLs. An employee could elect to attend training n only 

those topics which are appropriate to his circumstance. 

supervisors, training ^ vM training 

advise employees who seek guidance as 

modules are job appropriate. 

-lav be that some FVM topics could be 

avaiUbirin'a'cBl'IIde. In the near term. 

twvt-A cVilis modules would offer tne 
content of the VM course into skills mooux 

anployee lr.odul«‘would also 

necessary job-related skills. Such use oi 

foster increased FVM 

utilization of VM training. (For a oroaaei F r 
utilization referred to the outline 

training mod ules, the ISTD 

developed by 
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Course Critiques 

As presently constituted, the course critiques are of little 
use in either Uprovlng the design or the delivery of the FVM 
instruction. Since the FVM course represents training that is 
essential, rather than siuply desirable, a aore ueaningful 
critique perhaps could be in the fora of a certification that the 
students did, in fact, acquire the skills that were intended by 
the instruction. This type of skills specific critique informs 
both the instructor and the student of any deficiencies which 
aight warrant further attention either in the classroom or on the 

job. 


For a course designed and delivered as a series of separate, 
but related nodules, a demonstration of skill acquisition would 
be required at the end of each aodule. (This exercise should 
have parallel forms so the students can demonstrate mastery after 
correcting initial learning errors). 

In addition to using student performance on aodule specific 
exercises to evaluate the effectiveness of the course materials 
and instruction, the instructor should encourage all trainees to 
offer related comments in writing after the employee has had an 
opportunity to use on the job the skills acquired in the FVM 
course. Then, within 30-45 days after the close of each class, 
the FVM Training Assistant (TA) should telephone a random sample 
of students to determine the extent to which the student is using 
the training and what, if any, kinds of VM difficulties the 
student is having. The TA notes from these follow-up 
conversations would be used along with a profile of students’ 
aodule performance in conducting an annual ISTD review of the FVM 

course. 
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It should be noted that while it Is the Agency’s 
„.oonslbllity to provide training that Is essential to ]oi 
”rfor«nc“ It Is the responsibility o£ the Individual e.ployee 
and supervisor to use that training. Hence, an essential ‘rP® “ 
tlllnlng ««se such as FVH can only certify that at the end of 
the training the e.ployee could de.onstrate that he had acqui 
particular FVH knowledge and skills. It Is the e.ployee an 
Tupe vl r who nust then transfer and/or translate that earning 
Into lob perfornance. Until now the success of FVM has be n 
gauged principally by student perceptions of the quail y 
instruction; In the future, perhaps the success of the FVH course 
will be .easured prl.arlly by student achieve.ent in the course 

and on the job. 
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3 December 1984 


MEMORANDUM FOR: FVM Trainees 


FROM : ] 

Chiefs Information Systems 

Training Division, OTE 

SUBJECT: Evaluation of the Fundamentals of 

VM (FVM) Training Course 


STAT 


1. The Information Systems Training Division (ISTD) in the 
Office of Training and Education is evaluating the extent to 
which the Fundamentals of VM (FVM) course provides Agency 
employees with the VM skills necessary to meet their basic job 
requirements. This information will be used to revise the FVM 
course during the winter of 1985, 

2. As a consequence, we are asking all Agency employees 
who completed the FVM course in FY84 to participate, 
anonymously, in our evaluation. 

3. Enclosed are a questionnaire and a pre-addressed 
envelope. Our assessment will reflect the views of the group 
of FVM graduates and no comments will be attributed to an 
individual. To assure that your privacy will be protected, 
please do not sign or otherwise identify your questionnaire. 

4 ^ yc trust that you will offer your most candid opinions 
regarding the usefulness of the FVM course and that you will 
return the questionnaire no later than 7 January 1985. The 
results of this evaluation will be analyzed in January and we 
will forward an executive summary of the evaluation findings to 
you in February, 1985. 
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FUNDAMENTALS OF VM ( FVM ) QUESTIONNAIRE 

1 . General Information , 

1. When did you take FVM? month _year 

2. What was your job when you took FVM? 

. ✓ 

3. What is your job now? 

4. What was your grade level when you took FVM? 

What is your grade level now? 

5. Check all the ADP courses you have completed since your FVM 
course? 


IVM 

AIM 

SCRIPT 

HBWP 

EXEC2 

GIMS 

CAMS I 

CAMS II 

SAFE _ 

NOMAD2 

RAMIS I _ 

RAMIS II 


6. Is there a terminal in your immediate office? 

yes no 

7. Is there a terminal in a work area/work station in your 

office? yes no . Is it convenient for you? yes no 

8. Approximately how often do you use a VM terminal? 

virtually all the time (nearly every day) 
frequently (at least several times a week) 
sometimes (usually several times a month) 
rarely (once a month or less) 

hardly ever ( can count the number of times per year 
on one hand!) 

9. For what kinds of work do you USUALLY use the terminal? 
(Please check all that apply). 

files: to create, edit, manipulate files 

data: to do data analysis (e.g. SAS) 

documents: to write memos, reports, etc. 

electronic mail: to communicate with other users 

other. Please Specify: 
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TT Course Objectives. Please rate each of the FVM course 
objectives in tersts or how USEFUL that knowledge is to you 
HOW in your PRESENT JOB, using a scale of: 


(1) Hot Useful, 

(2) useful, 

(3) Very Useful, and 

? Don't know, can't say. 

Accessing VM via the Logon sequence 

Creating files 

Changing file content 

Sending information to another 
user 

Directing output to a printer 
Preparing for another ADP course 


12 3 7 
12 3 7 
12 3 7 

12 3 7 
12 3 7 
12 3 7 


III. Course Content. Using the same 3 point scale as 
in part II, please answer the following questions by 
the number that comes closest to your VM use. 


above , 
circling 


TO WHAT EXTENT DO YOU NOW USE 


1. xedit commands? 

2 particular xedit commands such as: 

input? 

find? 

locate? 

change? 

retype? 

putd fii get? 

3. CMS commands such as: listfile? 

copyfile? 

help? 

4. Sending files? 

5. Full screen editing ? 

6. Message function? 

7. FVM course book as a reference? 


1 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


2 3 


2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 


7 

? 

? 

? 

? 

? 

? 

? 

? 

? 

7 

? 
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IV. Possible Training Related to your job/car»er . ISTD Is In 
the process of identifying ADP training needs. Considering 
your work and your experience, we ask you please to rate each 
of the following on a scale of jL to £ (where 1 represents "not 
particularly important” and 3 is "extremely important" and 7 is 
"don't know/can't say"). Here, the notion of importance is in 
terms of what you think you and the people in your office need 
to carry out program/of fice/divislon/Agency objectives. 


Course 

Title 

SCRIPT 

Intermediate VM 
AIM 

RAMIS I or II 

MOMAD 

EXEC2 

BBHP 

GIMS 

CAMS I or II 
SAFE 

Other courses, please specify: 


Potential Importance 
to Agency Employees 

12 3 7 

12 3 7 

12 3 7 

12 3 7 

12 3 7 

12 3 7 

12 3 7 

1 2 3 7 

12 3 7 

12 3 7 

12 3 7 

12 3 7 

12 3 7 


V. If you were responsible for designing a FVM course, what 
topic/unlt/content that was NOT part of your course would you 
definitely include7 


Which, if any, of the topics/units in your course should have 
had more time spent on them7 
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yj , Course Assessment. Please desclbe your views as fully as 
possible for each of the following questions. 

1. Why did you take PVM7 


2. In what ways did the FVM course meet your objectives? 


3. In what ways were you disappointed by the FVM course (other 
than not having a 1-1 student to terminal ratio)? 


4. What kinds of problems/challenges have you encountered 
when you are using VM which you consider to be related to VM 
literacy? 


5 ^ Ifere there any elements/topics/units that, in hindsight, you 
have found to be especially worthwhile? 


6. Did you use VM before you took the course? If so, how much 
and in what ways? 


7 , Did you use another system (e.g. Wang, Apple) before 
learning VM? If so, how much and in what ways? 


8. What is your general recollection of the quality of the FVM 
instruction? 
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13 December 19B4 


MEMORANDUM FOR: FVM Trainees 


FROM: 

Chiefs Infornatlon Systems 
Training Division, OTE 

SUBJECT: The FVM Survey Questionnaire 


STAT 


1. If you have already completed and returned a 
questionnaire about your Fundamentals of VM (FVM) course, 
please disregard this missive. 

2. If, however, you have not yet had the opportunity to 
answer the survey questions, please delay no longer. 

3. The FVM survey findings will be the most useful If this 
assessment is based on the largest possible sample of opinions 
from trainees who took the course In FYSd. 

4. Since we will begin our analysis of the data soon after 
the first of the year, we need your questionnaire returned no 
l*ter than 7 January 1985. 

5. Again, thank you in advance for your participation in 
this evaluation effort. 


STAT 
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